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ABSTRACT: We consider a real time data •Acquisition and processing multiserver system with identical 
servers (such as unmanned aerial vehicles, machine controllers, overhearing devices, medical monitoring units, 
etc.) which can be maintained/programmed for different kinds of activities (e.g. passive or active). This system 
provides a service for real time tasks arriving via several channels (such as sur\'eillance regions, assembly 

lines, communication channels, etc.) and involves maintenance. 

1 *' | 1 

We focus on the worst vase analysis of the system with shortage of maintenance teams, exponentially distributed 
time to failure and maintenance times. We consider the model with nonpreemptive priorities and provide 
balance equations for steady state probabilities and various performance measures, when both operation and 
maintenance times are exponentially distributed. 
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I. Introduction 


ll 
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Real time systems- '(RTS) are imbedded in most modern technological structures, such as robotic 
systems, production control systems, radars, self-guided missiles, reconnaissance, aircraft, etc. These systems 
are widely used for the monitoring and control of physical processes. 

The sustained demands of the environments in which RTS operate pose relatively rigid requirements (such as 
time constraints) on their performance. ’ . ", l , 

In RTS a calculation that uses temporally invalid data or an action performed too early/late, may be sometimes 
harmful - even if such a calculation or action is functionally co'rrect. These systems are often associated with 
applications, in which human lives or expensive machinery may be at stakes. 

There exists a rich literature cavering RTS and different scientific communities are treating various problems in 
this area. We will site only a small portion oi: it: ‘ 

Liu and Layland in [11 presented analytic combinatorial analysis for multiprogramscheduling on a single 
processor. Dhall and Liu [2] treated the problem of specifying .afl'.order in which the requests made by a set 
ofperiodic real-time jobs are to be executed by a multiprocessor computing, system, with the goal of meeting all 
the deadlines with a minimum dumber of processors. Xio et al. in [3] presented a general cost model and an 
optimal solution algorithm achieving required performance objective for redundant RTS. 

Metaheuristic methods, such as Tabu Search [4] and Greedy Randomized Adaptive Search Procedure [5] were 
proposed during the last two decades of the previous century. A comprehensive survey on real-time decision 
problems in OR perspective is given in [6]. Good survey on applications of Artificial Intelligence to RTS is 
given in [7]. 

We focus on RTS with a zero deadline for the beginning of job processing. Queueing of jobs in such systems is 
impossible, since jobs are executed immediately upon arrival, conditional on system availability. That part of 
the job which is not processed immediately is lost forever and cannot be served later. 

The following works treated this type of RTS: Kreimer and Mehrez ([8] and [9]) have shown that the non-mix 
policy of never relieving an operative server maximizes the availability of a single channel RTS involving 
preventive maintenance and working in general regime with any arrival pattern under consideration and constant 
service and maintenance times. [10] and [11], [12] studied muliserver and multichannel (with identical servers 
and channels) RTS without priorities (with ample and limited maintenance facilities respectively), working 
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under maximum load regime as finite source queues (see [13]). Kreimer [14] applied the two dimensional birth 
and death processes in worst case analysis of a multiserver RTS (with ample and limited maintenance facilities 
respectively) with two different channels, when both service and maintenance times were exponentially 
distributed. Ianovsky and Kreimer [15] obtained optimal assignment/routing probabilities to maximize the 
availability of RTS with limited maintenance facilities, for large number of servers and two different channels. 
In [16] the steady state probabilities for RTS with arbitrary number of different channels operating under a 
maximum load regime were obtained. In [17] and [18] multiserver and multichannel RTS working in general 
regime (with ample and limited maintenance facilities respectively) are considered. In [19] a single-channel 
RTS with two different types of activities was studied. In [20] we computed analytically (for exponentially 
distributed service times) and via Cross Entropy [21],[22], [23] simulation approach (for generally distributed 
service times) optimal routing probabilities for RTS with ample maintenance facilities. In [24], [25] and [105] 
RTS with preemptive priorities are treated. In [27] RTS with nonpreemptive priorities and ample maintenance 
facilities was studied. 

The work presented here is a generalization of results obtained in [19] and [27] for RTS with several types of 
activities and limited maintenance facilities. It deals with multiserver RTS, providing the service to the requests 
of real-time jobs arriving via several channels. Servers are identical, but may be maintained/programmed for 
several kinds of activities. We provide balance equations describing the model with nonpreemptive priorities 
operating under a maximum load and show how to compute various performance measures, when both 
operation and maintenance times are exponentially distributed. 

The paper is organized as follows: In Section 2, the description of the model is presented. Section 3 provides 
balance equations for RTS with nonpreemptive priorities. Section 4 is devoted to description of various 
performance characteristics. Finally, Section 5 contains conclusions. 


II. The Model 

The most important characteristics of RTS with a zero deadline for the beginning of job processing are 
summarized in Kreimer and Mehrez [24] as follows: 

(i) Jobs/data acquisition and execution are as fast as the data arrival rate. 

(ii) Jobs are executed immediately upon arrival, conditional on system availability. Between jobs 
arrival and their execution, delays are negligible. 

(iii) That part of the job which is not executed in real time is lost forever. Storage of non-completed 
jobs or their parts is impossible. Therefore, queues of jobs do not exist in such an RTS. 

Nevertheless, some important elements of queueing theory can be applied in analysis of these RTS. 

We consider a multiserver multichannel RTS consisting of N identical servers (e.g. UAVs, machine controllers, 
overhearing devices, medical monitoring devices, etc.)that provide service for the requests of real time jobs, 
arriving via r identical channels (e.g. surveillance regions, assembly lines, communication channels, hospital 
patients, etc.). 

Each server can serve different channels, but not simultaneously. There is exactly one request in each channel at 
any moment (there are no additional job arrivals to busy channels), and therefore one server at most is used (with 
others being in maintenance or on stand-by or providing the service to another channel) to execute the job in this 
channel at any given time. Therefore, the total number of jobs in the system is r (as a number of channels). 
Different parts of the same job can be served by different servers. Any part of the job that is not executed 
immediately is lost. 

It is assumed that there are K (K<N) identical maintenance teams available to repair (with repair times R f 
beingindependent identically distributed random variables - i.i.d.r.v.) broken servers. Thus we have a shortage 
of maintenance teams, if the number of broken servers is more than K, and some of broken servers must wait for 
maintenance. A fixed server may be of one of m kinds (e.g. of activity or quality) with probabilities p t , 

i=I, ...,m respectively. These probabilities can be used sometimes as control parameters. It is worthwhile to note, 
that onlyafterthe maintenance is completed, the type of fixed server can be detected. The fixed server of i-th 
type is operative for a period of time S ( before requiring R f hours of repair. Both S i and R f areindependent 
exponentially distributed random values with parameters // ( (i=l,...m) and A, respectively. The duration R t of 
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maintenance does not depend on the server’s type (neither before nor after the maintenance).After maintenance 
is completed, the fixed server will either be on stand-by or providing service to one of channels. 

The system works under a maximum load of nonstop data arrival, which is equivalent to the case of a unique job 
of infinite duration in each one of r channels. This kind of operation is typical in high performance data 
acquisition and control systems. Decisions based on the nonstop data flow arriving via all /channels must be 
made in real time. If, during some period of time of length T, there is no available server to serve one of the 
channels, it means that the part of the job of length T is lost forever. 

Our purpose is to provide balance equations for steady-state probabilities of this system, its availability and 
other performance characteristics. 


III. Balance Equations 

We suppose that servers of first activity type have the highest priority, servers of the second activity type are 
after them, and so on, finally, servers of the m-th activity type have the lowest priority. Operating server is not 
interrupted, independently of its priority. When the operating server must be repaired, the fixed server with 
highest priority takes its place. 

We denote {(n 15 k l (fl m , fc m )} the state of the system, where ll ; is the total number of fixed 

servers of z'-th activity type and k L (z = l,..!,/«) is the number of operating (providing service) fixed servers of i- 
th activity type respectively, and p{(n t , k t ),(n m , k m )} the corresponding steady state probability. It is 


m 

clear that n x + ... + n m < N, n t >k t > 0, = min 


1=1 


z=i 


Theorem. Steady state probabilities for the model with nonpreemptive priorities with shortage of maintenance 
teams can be found from the following system of linear balance equations: 
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u \ ( Y) [0, if i ^ j 

where {(hj , k { J, (n , k Jj is any feasible state of the system, d = < 

l if i = j 


and 


Y j p{( n l ,k 1 ),...,(n m , k m )} = l, 

n l ,k l (n m , k m jleis 


( 2 ) 


_ in in m 

where E = l {(«,, k x ),..., {n m , k m )}: 0 < k i < n i ,i=l, m, ^ n i <N,^ k i = min r, ^ 


is the set of all feasible states of the system. 

/y 

Proof . 


i=i 

—\ 
A. 
■■A 


i=i 


v y =l y 


1) First we consider the case r > N . Then it is clear that fh = k j , i = 1, m, i.e. all fixed servers are busy and 
priorities do not work in this case. We have therefore 


min[/r,iVU ■ p{(0,0), (0,0),..., (0,0)} = 


[□j 


= J/t^{(0,0),...,(0,0),(n. =l,kj =l), (0,0),...,(0,0)}, 


j =i 


! O' 


for the state {(0,0),.. .,(0,0)}, i.e. n i = k i = 0 , i = 1, m ; 
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i 

M 
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for the states n t =k j , i=l,m , k i > 0 , j=\,s, k t =0 , j — s+l, m , 0 <s<m , 
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j =i j =i 
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Now equations (1) follow from equations (3)-(7). 

2) Next we consider the case r < N . Now priorities are working. Then we have 

equation (3) again for the state {(0,0),...,(0,0)}, i.e. n t = k i =0, i = 1, TO; 


equation (4) for the states n j = k f , i = 1, to , k r > 0, j = 1, s , k t = 0, j = s + 1, m, 
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m m 
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Other equations will differ. 
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1=1 
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Now equations (1) follow from equations (3), (4), (6), (8)-( 15). 

Q.E.D. 

■■ 'i 

IV. Performance Characteristics 

In this Section we shall show how to compute some useful performance characteristics of the RTS under 
consideration. 

Each server can be in one of following positions: 

(i) busy (operating); 

(ll) out of order (in maintenance); 

(iii) on stand-by; 

(iv) waiting for maintenance. 

Each channel can be in one of two positions: 

(i) in service; 

(ii) out of service. 

0- J f V. y\ ‘ ,< 

Keeping in mind that, the state of the system is represented by the vector {(ftj, k x ),..., (ft m , k m )}, where ft, 

r* 

(i= 1 , ...,»;) is the total number of fixed servers of /-th activity type and k j (/= 1 , ...,»;) is the number of operating 
fixed servers of /-th activity type, we can represent the number of servers and channels in different positions in 
terms of ft, and /c,, namely: 

m 

Number of fixed servers is ^ n i ; 

i =1 


m 

Number of operating fixed servers (the number of channels in service) is ^ k ; ; 

;=i 

Number of fixed servers of /-th activity type being on stand-by is ft,. — /c,; 
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Number of all fixed servers being on stand-by is ^ (n i —k i '); 

;=i 

m 

Number of broken servers is TV — /i, ; 

/=i 

m 

Number of channels out of service is r — ^ k : ; 


Number of broken servers in maintenance is min 


^ m \ 

N-Zn;,K 

V i=l 


Number of broken servers waiting for maintenance is max 


W-T.nl-K, 0 

I ■ i=i j 


Now we can obtain corresponding average values, using steady state probabilities, namely: 

L = E[n j ] - average number of fixed servers of ;-th activity type ( i = 1, m ); 

lit ■ 

L = ^ Lj - average number of all fixed servers; 

i=i 

N — L - average number of broken servers; 

E[k t ] - average number of operating servers of ;-th activity type (i = 1, m ); 

'iT I ■ I .am '— X _ 
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p\k j ] - average number of all operating servers (as well as the average number of channels in service); 
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y E\k i ] - average number of non-executed real-time jobs; 
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for average number of broken servers in maintenance; 
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for average number of broken servers waiting for maintenance; 
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L sb = E[n i — k i ] - average number of i-th type fixed servers on stand-by ( i — 1, m ); 


m 

^sb IX. sb - average number of all fixed servers on stand-by; 

i=1 

X av =X(N-L) - average rate of servers arriving from maintenance; 

-U = k>> (n -l) - average rate of i-th type servers arriving from maintenance ( i = 1, m ); 

Wj sb = L s/) jX av; - average time spent on stand-by by the i-th type server (I = 1, m ) - Little Theorem; 
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W ! = W i sb + 1/ p i - average time of the i-th type server being fixed (i — 1, ill ) - Little Theorem. 

The use of RTS relies on the principle of availability, which can be given in our case by the following formula 



Another important performance measure is the average cost of system operation during time unit. Denote C. 
(i=l,...,m) the cost of time unit activity of the i-th type server, and D the penalty paid for the time unit during 
which one of channels/jobs was not served. Then the average cost per time unit of system operation is defined as 
follows 


m m 

TC = £C,£[*,]+£> r-^Elk,] 


i =1 


i=l 


Dr-£(Z)-C,.)£[£,.] 

;=1 


V. Conclusions 

In this paper we provided equations for steady-state probabilities, as well as formulas for availability, average 
cost function and other performance characteristics of multiserver and multichannel RTS with different activity 
types and shortage of maintenance teams. We have examined models with nonpreemptive priorities. Practitioners 
and researchers can submit their parameters in equations for steady state probabilities and performance 
characteristics and to obtain the solutions. Further research should address following problems: 

• RTS with preemptive priorities; 

• RTS in which each server needs more than one land of maintenance; 

• Optimization of RTS involving costs and penalties; 

• Multilevel RTS; 

The use of queueing theory methodology will have significant benefits in analysis of these systems. 
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